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[57} ABSTRACT 

A system and method for voice controlled message retrieval. 
Each message stored in a voice mail system has an associ- 
ated header and return address. The system generates and 
stores a speech recognition template from each unique 
header. When a subscriber wishes to retrieve a message, the 
subscriber speaks the header. The subscriber's speech is then 
compared with the speech recognition templates stored in 
the system. If a matching template is found, the system plays 
the message associated with the header from which the 
template was generated. Additionally, the subscriber can tag 
certain callers and cause the system to apply special treat- 
ment to messages from tagged callers. Moreover, the sub- 
scriber can reply to a caller calling from outside the system. 

31 Claims, 2 Drawing Sheets 
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VOICE-CONTROLLED VOICE MAIL names from the list, such as. "mom S." The message in the 

HAVING RANDOM-ORDER MESSAGE database associated with "mom S" will be delivered to the 

RETRIEVAL BASED ON PLAYED SPOKEN called party. 

IDENTIFIER LIST After listening to the message, the called party has several 

5 options including replying to the message or tagging it. To 

TECHNICAL FIELD OF THE INVENTION rcp i y . the called party can simply say "reply." The voice mail 

This invention relates to data retrieval and more particular ^ *™ re ™* me ™* So 

to a system and method for retrieval of temporarily stored "ply to the caller ™ ^^V*" 

data using voice commands and even more^icularly to in *w^teMpWcn^ W ^ f ?LTt' 

such systems and methods for retrieving voice mail by 10 ^ ***** ™ U thc * P^ornpt the caUed W *^* 
, J . e , , r. treat the called party. For example, the voice marl system can 

simply saying the name of the person who left the message. , ""; , *^ y . M \. , . i „ , 

^ * J 6 ^ be configured to page the called party whenever the tagged 

BACKGROUND OF THE INVENTION caller calls. The voice mail system recognizes the tagged 

caller by utilizing the previously stored identity. 

It has now become almost common place for callers to 15 ^ fa . ^ outlined rather broadly the features and 

leave voice mad messages when a called party does n« advan , of ^ t invention m order ^ 

answer the telephone. In such systems the called party at ^ of the ^^0,, that follows may be 

some future time calls into a database to retrieve the mes- underst0 od. Additional features and advantages of the 

sage. To accomplish this task, the called party must enter a imtMkm wiu ^ described hereinafter which form the 

series of commands from the keypad and listen to various M s rf ^ cigims Qf ^ It should ^ apprc . . 

voice prompts in order to hear (or skip over) his or ha skiUed fa ^ ^ ^ ^ c , ion ^ 

messages. Typically, the party desinng to retrieve Ae mes- m / embodimcn , ^ ^ readily utilize( i as , 

sages does not know the content of the message and only in ^ of desi ^ ^ s(r(Jctures f<y cany . 

some situations (for example, when the party leaving the tlhe ^p^es of the present invention. It should 

message happens to be associated with the same system as 25 ^ *f£xt ikiiJei in ^ ^ mat such equ iva- 

the called party) does me removing party even know the constructi ons do not depart from the spirit and scope of 

identity of the party leaving the message. ^ as ^ fwth ^ appeIlded cUims 

In addition, the party retrieving the messages often cannot 

deliver a response to the caller unless the caller has an BRIEF DESCRIPTION OF THE DRAWINGS 

account on the same voice mail system as the retrieving 30 For a more complete understanding of the present 

party. Moreover, there is no way for the called party to invention, and the advantages thereof, reference is now 

identify certain callers and provide those callers with special ma ^ c to me following descriptions taken in conjunction with 

treatment. fa t accompanying drawings, in which: 

Thus, it would be advantageous if the retrieving party pjQ j illustrates a voice mail system adapted to execute 

could retrieve data, such as messages, in random order and * 5 ^ invention; 

without entering a scries of digits or responding to a series FIG 2 is a flow chart illustrating a hierarchical menu 

of inquiries. Preferably, such retrieval would be voice acti- systejn to ^ present invention; and 

vated * FIG. 3 is a flow chart illustrating the steps performed 

It would be a further advantage if the retrieving party when a u d caller ^ thc voicc ^ svstem of FIG. 1. 

could deliver a response to a caller located outside of the 

retrieving party's voice mail system. DESCRIPTION OF THE PREFERRED 

It would be yet another advantage if the retrieving party EMBODIMENTS 

could ia^tiry particular callers and provide special handling FIG. 1 illustrates a high-level overview of a voice mail 

for subsequent calls from those particular callers. 4J system and related components adapted to execute the 

present invention. Shown are a telephone 110. a switching 

SUMMARY OF THE INVENTION syste m 112 such as a central office or private branch 

These and other advantages are achieved by a system and exchange, and a voice mail system 114. Telephone 110 is a 

method in which a caller who is about to input data for standard telephone having a DTMF keypad 116 by which 

subsequent retrieval by another person is asked to identify x commands and numbers can be entered. It should be rec- 

himself or herself. The caller then provides his or her name. ognized that other devices, such a computer modem, can be 

a nickname, a code name. etc. In addition, the caller is asked substituted for telephone 110 and used with respect to the 

to leave a return address indicating where the caller can be present invention as described below, 

reached. The system then records the spoken identity and the Switching system 112 functions as a stand alone call 

associated return address in a database. 55 processor. Calls placed from telephone 110 may eventually 

The called party, in a voice-mail system, then queries the be directed by switching system 112 to voice mail system 

system to determine if messages are waiting and receives 114. Voice mail system 114 answers the call and processes 

from the system a spoken list of identities. These identities it as described below. Voice mail system 114 stores infor- 

are the identities which were previously stored in the data- mation necessary to perform its functions in database 118. 

base. The called party then speaks (repeats) one of the so Database 118 can be any general purpose storage device, 

identities from the list and the system then retrieves the data such as a hard drive. 

associated with that spoken identity. Throughout this specification, reference is made to a 

When the called party begins to retrieve his or her "caller" and a "subscriber." Unless otherwise indicated, the 

messages, for example, the called party will hear the mes- caller is the person leaving a message and the subscriber is 

sage: "You have five messages. Your messages are from, 65 the person for whom the message is left. 

Billy, Tom, Jim. David, and Mom S. Which message do you When the caller connects with the subscriber' s voice mail 

desire to hearT The speaker will respond with one of the system 114. the system prompts the caller to input a name 
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tag. or header. Usually, the header is the caller's name. 114 to treat any new messages from the same caller in a 
although it could also be a nickname or other means of special manner. When a tag command is received system 

identification. 114 marks the speech recognition template associated with 

Next, system 114 generates a speech recognition template the tagged message and saves the template in database 118. 

from the header. A speech recognition template is a data 5 At step 228, system 114 queries the subscriber for a type of 

construct well known in the art of speech recognition. tag. Possible tags could include: "page," which causes 

Essentially ; a template is a digital representation of a spoken system 114 t0 page At subs criber if the caller calls again: 

word or phrase stored in a format designed to ease com- - call mc » which causes ^ U4 to caU ^ subscri £ r tf 

parison of the template with other spoken words or phrases. tne ^ ^ ^ and ^ ^ which ^ 

If the caUer scall originates outside system 114 me caller 10 the caUer to voice mail. Obviously, other types of tags can 

!X' ZrF°T n inf t ? mat, ? n m ^ U ^ * e be developed depending upon the subscribers needs Once 

caller s return address. Usually, this information is the 4 , . c . - * . M « 

callus phone number and can be entered via the telephone ** ° f ^ 1S Mt SyStem 114 retUrns 10 stc P 222 ' 

keypad 116 or spoken. Alternatively, the return address can subscnber can ^ iSSue a "rq^y" command (step 

be determined via automatic number identification (AN3). *30)- ^ response, system 114 prompts the user to record a 

This return address information is associated with the call- 15 IC P l y Md schedule delivery (step 232). If the reply is 

er's speech recognition template and saved in the system's directed to another subscriber within voice mail system 114. 

database 118. then system 114 merely places the reply in that subscriber's 

Finally, the caller is prompted to leave a voice message in b° x - Otherwise, system 114 can be configured to deliver 

for the subscriber. The message is saved in voice mail we message to the return address left by the caller when the 

system 114 along with its associated header and return 20 message was recorded. Then, system 114 returns to step 222. 

address. Another possible command the subscriber can issue is 

System 114 saves incoming messages in an in box. "skip." The skip command (step 234) moves system 114 to 

Multiple messages from the same caller, as indicated by the the next message in the subscriber's queue. Accordingly, 

caller's return address, can be grouped together. In addition. system 114 returns to step 222. The skipped message 

the subscriber's saved messages are placed in a second box. 25 remains in the subscriber's in box. 

FIG. 2 is a flow diagram illustrating a preferred embodi- The "delete" command (step 236) deletes the current 
ment of a menu structure used by a subscriber to access message from the subscriber's in box. The "save** command 
messages in voice mail system 114. Note that system 114 is (step 238) saves the current message to a different location 
preferably voice activated. Accordingly, each time system 3Q within the subscriber's voice mail. In addition, the save 
114 receives an input from the subscriber, system 114 command can be made the default command if the sub- 
compares the input to the voice templates for each possible scriber does not speak a command within a predetermined 
command and to the voice templates for each voice message time period after the message is played. After the save or 
within system 114. Then, system 114 preferably plays a delete command, system 114 returns to step 222. 
prompt to the subscriber indicating that the command was 35 Of course, system 114 resembles a typical voice mail 
received and understood. system in that it may have other commands not represented 

Assume that the subscriber calls in to retrieve messages. in the flowchart of FIG. 2. For example, system 114 can have 
At step 210. voice mail system 114 answers the subscriber's a 'forward" command that forwards messages to other 
call. At this point, the subscriber identifies him or herself to subscribers or callers. Similarly, system 114 should have 
system 114 by. for example, speaking a password (step 212). ^ commands for traversing back up the command hierarchy 
Next, at step 214, system 114 asks the subscriber whether it and replaying the new message headers. All of these corn- 
should play new or saved messages. If the subscriber says mands can be implemented in a manner like those discussed 
"new," then system 114 moves to step 216 to process the above. 

new messages as described below. If the subscriber says FIG. 3 is a flow chart illustrating the steps performed 

"saved," then system 114 moves to step 218 and processes 45 when a tagged caller calls voice mail system 114. At step 

saved messages in substantially the same manner as 310, system 114 answers the caller's call. At step 312, 

described below with respect to new messages. system 114 prompts for and receives a header from the caller 

Alternatively, system 114 could be configured to move as discussed above with respect to FIG. 1. Next at step 314. 

directly from step 212 to step 216, thereby saving the system 114 compares the newly received header with a list 

subscriber the step of specifying new or saved messages. ^ of speech recognition templates marked in response to the 

At step 220. system 114 announces the number of new tag command as discussed with respect to step 226. 

messages and plays the headers of current messages in rapid If the caller's header matches a previously tagged header, 

succession. After the headers are played, system 114 waits then system 114 verifies that the caller is in fact the tagged 

for the subscriber to speak a particular header (step 222). caller (step 316). Step 316 could be performed, for example. 

After system 114 receives a spoken header from the 55 by asking the caller "Are you <play matching header>? M If 

subscriber, system 114 plays the message (step 224) having the caller indicates **yes , H then system 114 provides the 

the header that mostly matches that spoken by the sub- special treatment indicated by the subscriber at step 228 

scriber. If the subscriber remains silent system 114 plays the (step 318). Otherwise, system 114 handles the call in the 

messages in the order in which they were received. normal manner (step 320). 

While the message is playing, the subscriber can t< barge 60 Although the above system preferably responds to the 

in" with a new command. In other words, the subscriber can caller's and subscriber's spoken commands, system 114 can 

speak a command and voice mail system 114 will immedi- easily be adapted to respond to other forms of input For 

ately stop playing the message and process the command example, system 114 can be controlled by DTMF input or by 

Otherwise, system 114 plays the whole message and then a computer system coupled to voice mail system 114. 

waits for a command from the subscriber. 6 5 In addition, it should be noted that the command hierarchy 

Possible subscriber commands include: tag, reply, skip, discussed herein is exemplary in nature. Indeed, a prime 

delete, and save. The "tag" command (step 226) tells system advantage of using speech templates as disclosed herein is 
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that the command hierarchy can be greatly flattened. Instead 
of responding to a series of prompts, the subscriber need 
only speak a header to retrieve a message. 

Although the present invention and its advantages have 
been described in detail, it should be understood that various 
changes, substitutions and alterations can be made herein 
without departing from the spirit and scope of the invention 
as defined by the appended claims. 

What is claimed is: 

1. A system for storing messages from callers and for 
selectively retrieving the messages by a subscriber, com- 
prising: 

means for prompting each of said callers to utter a 
message identifier; 

means for associating said message identifiers with a 
specific message; 

means for storing the message identifiers and the associ- 
ated messages; 

means for playing a list of said message identifiers for said 
subscriber; 

means for determining whether an input received from the 
subscriber matches a stored message identifier; and 

means for playing the message associated with a matched 
one of the stored message identifiers. 

2. The system of claim 1, further comprising: 

means for providing special treatment for subsequent calls 
to the system from certain callers. 

3. The system of claim 2, wherein the means for providing 
special treatment comprises: 

means for notifying the subscriber when certain callers 
call the system, 

4. The system of claim 2, wherein the means for providing 
special treatment further comprises: 

means for prompting a subsequent caller to input a 

subsequent uttered message identifier; 
means for comparing the subsequent message identifier 

with previously stored message identifiers; and 
means for verifying that a matched subsequent message 

identifier identifies the caller. 

5. The system of claim 1, further comprising: 

means for saving the message identifiers after the asso- 
ciated messages have been deleted. 

6. The system of claim 1. further comprising: 
means for prompting the subscriber for the input. 

7. The system of claim 1. wherein the associating means 
includes: 

means for associating a caller's return address with the 
message. 

8. The system of claim 7. wherein the means for associ- 
ating a return address includes means for automatically 
determining a communication location of the caller. 

9. The system of claim 7, further comprising: 

means for automatically delivering a reply from the 
subscriber to the caller* s return address. 

10. The system of claim 7, wherein the caller's return 
address is remote from the system. 

11. The system of claim 1. wherein the associating means 
comprises means for recognizing a speech pattern of a caller. 

12. The system of claim 1. wherein the identity is a name 
tag. 

13. The system of claim 1. further comprising: 

means for converting the message identifiers into speech 
recognition templates. 

14. The system of claim 13, wherein the means for 
determining comprises: 
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means for comparing the input with the speech recogni- 
tion templates. 

15. The system as set forth in claim 1 wherein said 
determining means includes: 

5 means for sequentially communicating a list of said 
message identifiers to said subscriber without commu- 
nicating the associated message. 

16. A method of delivering a message from a caller to a 
subscriber of a voice mail system, comprising the steps of: 

10 prompting the caller to input a header utterance identify- 
ing the caller and to input a message associated there- 
with; 

storing the header utterance; 

playing the header utterance to the subscriber upon com- 
l5 mand of the subscriber; 

receiving an input from the subscriber; 

comparing the input with the stored header utterance; and 

if the input matches the stored header utterance, playing 
the message identified by the header utterance to the 
20 subscriber. 

17. The method of claim 16. further comprising the step 

of: 

providing special treatment for subsequent calls to the 
voice mail system based upon recognition of the call- 
25 er's voice patterns. 

18. The method of claim 17. wherein the providing special 
treatment step comprises the step of: 

notifying the subscriber when the caller calls the voice 
mail system. 

so 19. The method of claim 17. wherein the providing step 
comprises the steps of: 

comparing the header utterance with previously stored 
header utterances to determine a matched previously 
stored header utterance; and 
35 verifying that said matched previously stored header 
utterance identifies the caller. 

20. The method of claim 16. wherein the presenting step 
comprises the steps of: 

playing a list of header utterances to the subscriber; and 
40 prompting the subscriber for the input. 

21. The method of claim 16, further comprising the step 
of: 

associating the message with information indicating 
45 where the caller can be reached. 

22. The method of claim 21, further comprising the step 
of: 

delivering a reply from the subscriber to the caller by 
automatically using the information indicating where 
jq the caller can be reached. 

23. The system of claim 21. wherein the caller is remote 
from the voice mail system, 

24. The method of claim 21, wherein the step of associ- 
ating the message with information uses automatic number 

55 identification to determine a communication location of the 
caller. 

25. The method of claim 16. further comprising the step 
of: 

converting the header utterance into a speech recognition 
60 template; and 

wherein the comparing step compares the input with the 
speech recognition template. 

26. A method of replaying one or more messages from one 
or more callers, comprising the steps of: 

65 playing a list of headers to a subscriber, each header 
identifying a message left by a caller on a voice mail 
system; 
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receiving a voice input from the subscriber; 
comparing the voice input against the played list of 

headers to find a matching header; and 
playing the message identified by the matching header. 

27. The method of claim 26. further comprising the step 5 
of: 

providing special treatment for subsequent calls from the 
caller who left the message identified by the matching 
header. 

28. The method of 27. wherein the providing special 
treatment step comprises the step of: 

notifying the subscriber when the caller makes a subse- 
quent call to the system. 

29. The method of claim 26. further comprising the step 15 

of: 

generating a speech recognition template for each header 
in the list; 
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wherein the comparing step compares the voice input to 
the speech recognition templates. 

30, A method for processing messages in a voice mail 
system, said method comprising the steps of: 

obtaining a spoken identifier from a message -leaving 
party; 

playing, upon request of said subscriber, a list of all 
spoken identifiers left by said message-leaving parties. 

31. The method as set forth in claim 30 further comprising 
the steps of: 

accepting a subscriber selection of one of said spoken 

identifiers; and 
delivering, to said subscriber, a message related to said 

subscriber-selected spoken identifier. 

***** 
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